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Adaptive filtering based upon boundary strength 



(54 

(57) In an image encoder and a corresponding de- 
coder, adjacent regions are identified in an image. Cod- 
ing parameters for the adjacent regions are identified. 
Selective filtering is performed at the region between the 
identified adjacent regions. The selective filtering is 



based upon determining whether at least two of said ad- 
jacent regions have an absolute difference (IV(j, x)-V(k, 
x )l; |V G. y)-V( k . y) 1 ) of said motion vectors of said at least 
two adjacent regions at least one of greater than or less 
than a threshold value. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] Block based motion compensated video cod- 
ing is used in many video compression standards, such 
as for example, H.261, H.263, H.263+, MTEG-1, 
MPEG-2, and H26L Block based motion compensation 
encodes video pixels in a block by block manner using 
image compression techniques. The image compres- 
sion techniques normally use lossy compression tech- 
niques that result in visual artifact in the decoded imag- 
es, referred to generally as image artifacts. One type of 
image artifacts are blocking artifacts that occur along 
the block boundaries in a reconstructed image. The pri- 
mary source of the blocking artifacts result from coarse 
quantization of transform coefficients used to encode 
the blocks. 

[0002] Reconstructed images are the images pro- 
duced after the blocks are inverse transformed and de- 
coded. Image filtering techniques may be used to re- 
duce the artifacts in reconstructed images. The rule of 
thumb for these image filtering techniques is that image 
edges should be preserved while the rest of the image 
should be smoothed. A low pass filter may be used as 
the image filter and its characteristics should be select- 
ed based on the characteristics of a particular pixel or 
set of pixels surrounding the image edges. 
[0003] Non-correlated image pixels that extend 
across image block boundaries are specifically filtered 
to reduce blocking artifacts. While filtering techniques 
reduce blocking artifacts, however, these filtering tech- 
niques may unfortunately introduce blurring artifacts in- 
to the image. For example, if there are few or no blocking 
artifacts present between adjacent blocks, then the low 
pass filtering needlessly incorporates blurring into the 
image while at the same time wasting processing re- 
sources. 

[0004] JP 2001-204029 discloses a noise detection 
method and apparatus and an image decoding appara- 
tus, wherein blocking artifacts are detected. The coding 
noise is detected according to frequency component 
distributions of orthogonal transformation coefficients of 
overlapping blocks. 

[0005] According to one aspect of the present inven- 
tion there is provided an encoder for encoding an image 
comprising: (a) a processor adapted to identify adjacent 
regions in said image; (b) said processor examining 
coding parameters for said adjacent regions; and (c) 
said processor selectively filtering at least a portion of 
the region proximate the boundary between said adja- 
cent regions based upon said coding parameters, 
wherein said selectively filtering is based upon deter- 
mining whether at least two of said adjacent regions 
have an absolute difference (IV(j, x)-V(k, x)l; IV(j, y)-V 
(k, y)l) of said motion vectors of said at least two adja- 
cent regions at least one of greater than or less than a 
threshold value. 
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[0006] According to another aspect of the present in- 
vention there is provided a decoder for decoding an im- 
age comprising: (a) a processor adapted to identify ad- 
jacent regions in said image; (b) said processor exam- 

5 ining coding parameters for said adjacent regions; and 
(c) said processor selectively filtering at least a portion 
of the region proximate the boundary between said ad- 
jacent regions based upon said coding parameters, 
wherein said selectively filtering is based upon deter- 

10 mining whether at least two of said adjacent regions 
have an absolute difference (IV(j, x)-V(k, x)l; IV(j f y)-V 
(k, y)l) of said motion vectors of said at least two adja- 
cent regions said absolute difference being at least one 
of greater than or less than a threshold value. 

15 

• BRIEF DESCRIPTION OF THE DRAWINGS 
[0007] 

FIG. 1 is a diagram showing how deblock filtering 
is selectively skipped according to similarities be- 
tween adjacent image blocks. 
FIG. 2 is a diagram showing two adjacent image 
blocks having similar motion vectors. 
FIG. 3 is a diagram showing how transform coeffi- 
cients are identified for one of the image blocks. 
FIG. 4 is a diagram showing how residual transform 
coefficients are compared between two adjacent 
image blocks. 

FIG. 5 is a block diagram showing how the video 
image is encoded and decoded. 
FIG. 6 is a block diagram showing how deblock fil- 
tering is selectively skipped in a codec. 
FIG. 7 is a representation of an existing block based 
image filtering technique. 

FIG. 8 is a block diagram showing a technique for 
determining the boundaries to filter and the strength 
of the respective filter to use. 
FIG. 9 is a drawing for explaining other embodiment 
of the present invention. 

FIG. 1 0 is a drawing for explaining further embodi- 
ment of the present invention. 
FIG. 11 is a drawing for explaining further embodi- 
ment of the present invention. 
FIG. 12 is a drawing for explaining further embodi- 
ment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

[0008] Conventional filtering processes consider a 
single reconstructed image frame at a time. Block based 
video encoding techniques may use motion vectors to 
estimate the movement of blocks of pixels. The motion- 
vector information is available at both the encoder and 
decoder but is not used with conventional filtering proc- 
esses. For example, if two adjacent blocks share the 
same motion vector with respect to the same reference 
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image frame, (for a multiple reference frames system) 
there is likely no significant difference between the im- 
age residuals of each block and accordingly should not 
be filtered. In essence, adjacent portions of the image 
have the same motion with respect to the same refer- 
ence frame and accordingly no significant difference be- 
tween the image residuals would be expected. In many 
cases, the block boundary of these two adjacent blocks 
may have been filtered in the reference frame and 
should therefore not be filtered again for the current 
frame. If a deblock filter is used without considering this 
motion-vector information, the conventional filtering 
process might filter the same boundary again and again 
from frame to frame. This unnecessary filtering not only 
causes unnecessary blurring but also results in addition- 
al filter computations. 

[0009] FIG. 1 illustrates an image 12 that selectively 
filters blocking artifacts according to similarities be- 
tween image blocks. It is to be understood that the im- 
age may likewise use non-square blocks or any other 
sets of pixels. The boarders between some of the blocks 
14 include blocking artifacts 18. In general blocking ar- 
tifacts are any image discontinuities between blocks 14 
that may result from the encoding and/or decoding proc- 
ess. A low pass filter or other filter may be used to reduce 
the blocking artifacts that exist at the boarders of adja- 
cent image blocks. 

[0010] For example, blocking artifacts 24 exist be- 
tween blocks 20 and 22. A low pass filter may be used 
at the boarder 26 between blocks 20 and 22 to remove 
or otherwise reduce the blocking artifacts 24. The low 
pass filter, for example, selects a group of pixels 28 from 
both sides of the boarder 26. An average pixel value, or 
any other statistical measure, is derived from the group 
of pixels 28. Then each individual pixel is compared to 
the average pixel value. Any pixels in group 28 outside 
of a predetermined range of the average pixel value is 
then replaced with the average pixel value. 
[001 1 ] As previously described, if there are few or no 
blocking artifacts 24 between the adjacent pixels, then 
the groups of pixels 28 may be needlessly filtered caus- 
ing blurring in the image. A skip mode filtering scheme 
may use the motion estimation and/or compensation in- 
formation for adjacent image blocks as a basis upon 
which to selectively filter. If the motion estimation and 
compensation information is sufficiently similar the fil- 
tering may be skipped. This avoids unnecessary image 
blurring and significantly reduces the required number 
of filtering operations, or any other appropriate value. 
[0012] As an example, it may be determined during 
the encoding process that adjacent image blocks 30 and 
32 have similar coding parameters. Accordingly, the de- 
block filtering may be skipped for the groups of pixels 
34 that extend across the boarder 31 between adjacent 
blocks 30 and 32. Skip mode filtering can be used for 
any horizontal, vertical, or otherwise any boundary be- 
tween adjacent blocks in the image 12. 
[0013] FIG. 2 illustrates a reference frame 42, refer- 
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ence frame 48; and a current frame 40 that is currently 
being encoded or decoded. The coding parameters for 
blocks 44 and 46 are compared to determine whether 
the deblock filtering should be skipped between the two 
5 adjacent blocks 44 and 46. One of the encoding param- 
eters that may be compared is the motion vectors (MV) 
for the blocks 44 and 46. 

[0014] A motion vector MV1 points from block 44 in 
the current image frame 40 to an associated block 44' 

10 jn the reference image 42. A motion vector MV2 points 
from block 46 in the current image frame 40 to an asso- 
ciated block 46' in the reference frame 42. A skip mode 
filtering checks to see if the motion vectors MV1 and 
MV2 point to adjacent blocks in the same reference 

15 frame 42. If the motion vectors point to adjacent blocks 
in the same reference frame (MV1=MV2), then the de- 
block filtering may be skipped. This motion vector infor- 
mation may be used along with other coding information 
to decide whether to skip deblock filtering between the 

20 two image blocks 44 and 46. 

[0015] More than one reference frame may be used 
during the encoding and decoding process. For exam- 
ple, there may be another reference frame 48. The ad- 
jacent blocks 44 and 46 may have motion vectors point- 

25 ing to different reference frames. In one example, the 
decision to skip deblock filtering depends on whether 
the motion vectors for the two adjacent bloclcs point to 
the same reference frame. For example, image block 44 
may have a motion vector 49 pointing to reference frame 

30 48 and image block 46 may have the motion vector MV2 
pointing to reference frame 42. The deblock filtering is 
not skipped in this example because the motion vectors 
49 and MV2 point to different reference frames. 
[0016] FIG. 3 illustrates another example of a coding 

35 parameter that may be used to decide whether or not to 
selectively skip deblock filtering. The image block 44 
from image frame 40 is compared with reference block 
44' from the reference frame 42 pointed to by the motion 
vector MV1 as previously illustrated in FIG. 2. A residual 

40 block 44" is output from the comparison between image 
block 44 and reference block 44'. A transform 50 is per- 
formed on the residual block 44" creating a transformed 
block 44" of transform coefficients. In one example, the 
transform 50 is a Discrete Cosine Transform. The trans- 

45 formed block 44" includes a D.C. components 52 and 
A.C. components 53. 

[0017] The D.C. component 52 refers to a lowest fre- 
quency transform coefficient in image block 44. For ex- 
ample, the coefficient that represents'the average ener- 

so gy in the image block 44. The A.C. components 53 refer 
to the transform coefficients that represent the higher 
frequency components in the image block 44. For ex- 
ample, the transform coefficients that represent the 
large energy differences between pixels in the image 

55 block 44. 

[0018] FIG. 4 illustrates the transformed residual 
blocks 44" and 46". The D.C. components 52 from the 
two transformed blocks 44" and 46" are compared in 
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processor 54. If the D.C. components are the same or 
within some range of each other, the processor 54 no- 
tifies a deblock filter operation 56 to skip deblock filtering 
between the boarder of the two adjacent blocks 44 and 
46. If the D.C. components 52 are not similar, then no 
skip notification is initiated and the boarder between 
blocks 44 and 46 Is deblock filtered. 
[0019] In one example, the skip mode filtering may be 
incorporated into the Telecommunications Sector of the 
International Telecommunication Union (ITU-T) pro- 
posed H.26L encoding scheme. The H.26L scheme us- 
es 4x4 integer Discrete Cosine Transform (DCT) blocks. 
If desired, only the D.C. component of the two adjacent 
blocks may be checked. However some limited low fre- 
quency A.C. coefficients may likewise be checked, es- 
pecially when the image blocks are larger sizes, such 
as 9x9 or 16x16 blocks. For example, the upper D.C. 
component 52 and the three lower frequency A.C. trans- 
form coefficients 53 for block 44" maybe compared with 
the upper D.C. component 52 and three lower frequency 
A.C. transform coefficients 53 for block 46". Different 
combinations of D.C. and/or any of the A.C. transform 
coefficients can be used to identify the relative similarity 
between the two adjacent blocks 44 and 46. 
[0020] The processor 54 can also receive other cod- 
ing parameters 55 that are generated during the coding 
process. These coding parameters include the motion 
vectors and reference frame information for the adjacent 
blocks 44 and 46 as previously described. The proces- 
sor 54 may use some or all of these coding parameters 
to determine whether or not to skip deblock filtering be- 
tween adjacent image blocks 44 and 46. Other encoding 
and transform functions performed on the image may 
be carried out in the same processor 54 or in a different 
processing circuit. In the case where all or most of the 
coding is done in the same processor, the skip mode is 
simply enabled by setting a skip parameter in the filter- 
ing routine. 

[0021] FIG. 5 shows how skip mode filtering may be 
used in a block-based motion-compensated Coder-De- 
coder (Codec) 60. The codec 60 is used for inter-frame 
coding. An input video block from the current frame is 
fed from box 62 into a comparator 64. The output of a 
frame buffering box 80 generates a reference block 81 
according to the estimated motion vector (and possible 
reference frame number). The difference between the 
input video block and the reference block 81 is trans- 
formed in box 66 and then quantized in box 68. The 
quantized transform block is encoded by a Variable 
Length Coder (VLC) in box 70 and then transmitted, 
stored, etc. 

[0022] The encoding section of the codec 60 recon- 
structs the transformed and quantized image by first In- 
verse Quantizing (IQ) the transformed image in box 72. 
The inverse quantized image is then inverse trans- 
formed in box 74 to generate a reconstructed residual 
image. This reconstructed residual block is then added 
in box 76 to the reference block 81 to generate a recon- 
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structed image block. Generally the reconstructed im- 
age is loop filtered in box 78 to reduce blocking artifacts 
caused by the quantization and transform process. The 
filtered image is then buffered in box 80 to form refer- 

5 ence frames. The frame buffering in box 80 uses the 
reconstructed reference frames for motion estimation 
and compensation. The reference block 81 is compared 
to the input video block in comparator 64. An encoded 
image is output at node 71 from the encoding section 

10 and is then either stored or transmitted. 

[0023] In a decoder portion of the codec 60, a variable 
length decoder (VLD) decodes the encoded image in 
box 82. The decoded image is inverse quantized in box 
84 and inverse transformed in box 86. The reconstruct- 

*5 ed residual image from box 86 is added in the summing 
box 88 to the reference block 91 before being loop fil- 
tered in box 90 to reduce blocking artifacts and buffered 
in box 92 as reference frames. The reference block 91 
is generated from box 92 according to the received mo- 

20 tion vector information. The loop filtered output from box 
90 can optionally be post filtered in box 94 to further re- 
duce image artifacts before being displayed as, a video 
image in box 96. The skip mode filtering scheme can be 
performed in any combination of the filtering functions 

25 in boxes 78, 90 and 94. 

[0024] The motion estimation and compensation in- 
formation available during video coding are used to de- 
termine when to skip deblock filtering in boxes 78, 90 
and/or 94. Since these coding parameters are already 

30 generated during the encoding and decoding process, 
there are no additional coding parameters that have to 
be generated or transmitted specially for skip mode fil- 
tering. 

[0025] FIG. 6 shows is further detail how skip mode 

35 filtering may be used in the filters 78, 90, and/or 94 in 
the encoder and decoder in FIG. 5. The interblock 
boundary between any two adjacent blocks T and "k" 
is first identified in box 1 00. The two blocks may be hor- 
izontally or vertically adjacent in the image frame. Deci- 

40 sion box 1 02 compares the motion vector mv(j) for block 
j with the motion vector mv(k) for block k. It is first de- 
termined whether the two adjacent blocks j and k have 
the same motion vector pointing to the same reference 
frame. In other words, the motion vectors for the adja- 

45 cent blocks point to adjacent blocks (mv(j) = mv(k)) in 
the same reference frame (ref(j)=ref(k)). 
[0026] It is then determined whether the residual co- 
efficients for the two adjacent blocks are similar. If there 
is no significant difference between the image residuals 

so of the adjacent blocks, for example, the two bloclts j and 
k have the same of similar D.C. component (dc(j) dc(k)), 
then the deblock filtering process in box 1 04 is skipped. 
Skip mode filtering then moves to the next interblock 
boundary in box 1 06 and conducts the next comparison 

55 in decision box 102. Skip mode filtering can be per- 
formed for both horizontally adjacent blocks and verti- 
cally adjacent blocks. 

[0027] In one embodiment, only the reference frame 
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and motion vector information for the adjacent image 
blocks are used to determine block skipping. In another 
embodiment, only the D.C. and/or A.C. residual coeffi- 
cients are used to determine block skipping. In another 
embodiment, the motion vector, reference frame and re- 
sidual coefficients are all used to determine block skip- 
ping. 

[0028] The skip mode filtering scheme can be applied 
to spatially subsampled chrominance channels. For ex- 
ample in a case with 4:2:0 color format sequences, skip 
mode filtering for block boundaries may only rely on the 
equality of motion vectors and D.C. components for the 
luminance component of the image. If the motion vec- 
tors and the D.C. components are the same, deblock 
filtering is skipped for both the luminance and chromi- 
nance components of the adjacent image blocks. In an- 
other embodiment, the motion vectors and the D.C. 
components are considered separately for each lumi- 
nance and chrominance component of the adjacent 
blocks. In this case, a luminance or chrominance com- 
ponent for adjacent blocks may be deblock filtered while 
the other luminance or chrominance components for the 
same adjacent blocks are not deblock filtered. 
[0029] Referring to FIG. 7, a technique recently pro- 
posed by others in H.26L defines a "block strength" pa- 
rameterfor the loop filterto control the loop filtering proc- 
ess. Each block of an image has a strength value that 
is associated with the block and controls the filtering per- 
formed on all of its four block boundaries. The block 
strength value is derived based on the motion vectors 
and the transform coefficients available in the bitstream. 
However, after consideration of the use of the block 
strength value for all four edges of the block, the present 
inventors came to the realization this results in removing 
some blocking artifacts at some edges while blurring 
along other edges. 

[0030] In contrast to the block by block manner of fil- 
tering, the present inventors came to the realization that 
filtering determinations should be made in an edge by 
edge manner together with other information. The other 
information, may include for example, information relat- 
ed to intra-block encoding of blocks, information related 
to motion estimation of blocks with residual information, 
information related to motion estimation of blocks with- 
out residual information, information related to motion 
estimation of blocks without residuals having sufficient 
differences, information related to reference frames, 
and information related to motion vectors of adjacent 
blocks. One, two, three, or four of these information 
characteristics may be used to improved filtering abili- 
ties in an edge by edge manner. Based upon different 
sets of characteristics, the filtering may be modified, as 
desired. 

[0031] For each block boundary a control parameter 
is preferably defined, namely, a boundary strength Bs. 
Referring to FIG. 8 a pair of blocks sharing a common 
boundary are referred to as j and k. A first block 200 
checks to see if either one of the two blocks is intra- 
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coded. If either is intra-coded then the boundary 
strength is set to three at block 202. Block 200 deter- 
mines if both of the blocks are not motion predicted. If 
no motion prediction is used then the block derives from 
5 the frame itself and accordingly there should be filtering 
performed on the boundary. This is normally appropriate 
because intra-coded block boundaries normally include 
blocking artifacts. 

[0032] If both of the blocks j and k are, at least in part, 

10 predicted from a previous or future frame, then the 
blocks j and k are checked at block 204 to determine if 
any coefficients are coded. The coefficients, may be for 
example, discrete cosine transform coefficients' If either 
of the blocks j and k include non-zero coefficients, then 

*5 at least one of the blocks represent a prediction from a 
previous or future frame together with modifications to 
the block using the coefficients, generally referred to as 
residuals, if either of the blocks j and k include non-zero 
coefficients (and motion predicted) then the boundary 

20 strength is set to two at block 206. This represents an 
occurrence where the images are predicted but the pre- 
diction is corrected using a residual. Accordingly, the im- 
ages are likely to include blocking artifacts. 
[0033] If both of the blocks j and k are motion predict- 

25 ed and do not include non-zero coefficients, generally 
referred to as residuals, then a determination at block 
208 is made to check if the pixels on either side of the 
boundary are sufficiently different from one another. 
This may likewise be used to determine if the residuals 

30 are sufficiently small. If a sufficient difference exists then 
a blocking artifact is likely to exist. Initially a determina- 
tion is made to determine if the two blocks use different 
reference frames, namely, R(j) * R(k). If the blocks j and 
k are from two different reference frames then the 

35 boundarystrength is assigned a value of one at block 
210. Alternatively, if the absolute difference of the mo- 
tion vectors of the two image blocks is checked to de- 
termine if they are greater than or equal to 1 pixel in 
either vertical or horizontal directions, namely, IV(j,x)-V 

40 (k,x)l^1 pixel or I VG,y)-V(k,y)l>1 pixel. Other threshold 
values may likewise be used, as desired, including less 
than or greater than depending on the test used. If the 
absolute difference of the motion vectors is greater than 
or equal to one then the boundary strength is assigned 

45 a value of one. 

[0034] If the two blocks j and k are motion predicted, 
without residuals, are based upon the same frame, and 
have insignificant differences, then the boundary 
strength value is assigned a value of zero. If the bound- 

50 ary strength value is assigned a value of zero the bound- 
ary is not filtered or otherwise adaptively filtered accord- 
ingly to the value of the boundary strength, it is to be 
understood that the system may lightly filter if the bound- 
ary strength is zero, if desired. 

55 [0035] The value of the boundary strength, namely, 
one, two, and three, is used to control the pixel value 
adaptation range in the loop filter. If desired, each dif- 
ferent boundary strength may be the basis of a different 
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filtering. For example, in some embodiments, three 
kinds of filters may be used wherein a first filter is used 
when Bs=1 , a second filter Is used when Bs=2 and a 
third filter is used when Bs=3. It is to be understood that 
non-filtering may be performed by minimal filtering In 
comparison to other filtering which results in a more sig- 
nificant difference. In the example shown in FIG. 8 the 
larger the value for Bs the greater the filtering. The fil- 
tering may be performed by any suitable technique, 
such as methods described in Joint Committee Draft 
(CD) of the Joint Video Team (JVT) of ISO/IEC MPEG 
and ITU-T VCEG (JVT-C167) or other known methods 
for filtering image artifacts. 

[0036] Skip mode filtering can be used with any sys- 
tem that encodes or decodes multiple image frames. For 
example, DVD players, video recorders, or any system 
that transmits image data over a communications chan- 
nel, such as over television channels or over the Inter- 
net. It is to be understood that the system may use the 
quantization parameter as a coding parameter, either 
alone or in combination with other coding parameters. 
In addition, it is to be understood that the system may 
be free from using the quantization parameter alone or 
free from using the quantization parameter at all for pur- 
poses of filtering. 

[0037] The skip mode filtering described above can 
be implemented with dedicated processor systems, mi- 
cro controllers, programmable logic devices, or micro- 
processors that perform some or all of the operations. 
Some of the operations described above may be imple- 
mented in software and other operations may be imple- 
mented in hardware. 

[0038] For the sake of convenience, the operations 
are described as various interconnected functional 
blocks or distinct software modules. This is not neces- 
sary, however, and there may be cases where these 
functional blocks or modules are equivalently aggregat- 
ed into a single logic device, program or operation with 
unclear boundaries. In any event, the functional blocks 
and software modules or described features can be im- 
plemented by themselves, or in combination with other 
operations in either hardware or software. 
[0039] In some embodiments of the present invention, 
as illustrated in Figure 9, image data 902 may be input 
to an image data encoding apparatus 904 which in- 
cludes the adaptive filtering portion as described above 
for some embodiments of the present invention. Output 
from the image data encoding apparatus 904 is an en- 
coded image data and may then be stored on any com- 
puter-readable storage media 906. The storage media 
may includes, but not limited to, disc media, memory 
• card media or digital tape media. Storage media 906 
may act as a short-term buffer or as a long-term storage 
device. The encoded image data may be read from stor- 
age media 906 and decoded by an image data decoding 
apparatus 908 which includes the adaptive filtering por- 
tion as described above for some embodiments of the 
present invention . The decoded image data may be pro- 
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vided for output decoded image data 91 0 to a display or 
other device. 

[0040] In some embodiments of the present invention, 
as illustrated in Figure 10, image data 1 002 may be en- 

s coded and the encoded image data may then be stored 
on storage media 1006. The basic procedure of image 
data encoding apparatus 1 004, storage media 1 006 and 
image data decoding apparatus 1008 is as same as in 
Figure 9. In Figure 10, Bs data encoding portion 1012 

10 receives the value of the boundary strength Bs for each 
block boundary and encoded by any data encoding 
method which includes DPCM, multi-value run-length 
coding, transform coding with loss-less feature and so 
on. The boundary strength Bs may be generated as de- 

*5 scribed in Figure 8. The encoded boundary strength 
may then be stored on storage media 1006. In one ex- 
ample, the encoded boundary strength may be stored 
separately from the encoded image data. In other ex- 
ample, the encoded boundary strength and the encoded 

20 image data may be multiplexed before storing on the 
storage media 1006. 

[0041] The encoded boundary strength may be read 
from storage media 1 006 and decoded by Bs data de- 
coding portion 1014 to input the decoded boundary 

25 strength to image data decoding apparatus 1 008. When 
the decoded boundary strength is utilized in image data 
decoding apparatus 1008 to perform the adaptive filter- 
ing of the present invention, it may not be necessary to 
repeat the process described in Figure 8 to generate 

30 boundary strength and this may save the processing 
power for the adaptive filtering. 
[0042] In some embodiments of the present invention , 
as illustrated in Figure 1 1 , image data 1 1 02 may be input 
to an image data encoding apparatus 1104 which in- 

35 eludes the adaptive filtering portion as described above 
for some embodiments of the present invention. Output 
from the image data encoding apparatus 1 1 04 is an en- 
coded image data and may then be sent over a network, 
such as a LAN, WAN or the Internet 1106. The encoded 

40 image data may be received and decoded by an image 
data decoding apparatus 1105 which also communi- 
cates with network 11 06. The image data decoding ap- 
paratus 1108 includes the adaptive filtering portion as 
described above for some embodiments of the present 

45 invention . The decoded image data may be provided for 
output decoded image data 1110 to a display or other 
device. 

[0043] In some embodiments of the present invention, 
as illustrated in Figure 12, image data 1202 may be en- 

50 coded and the encoded image data may then be sent 
over a network, such as a LAN, WAN or the Internet 
1206. The basic procedure of image data encoding ap- 
paratus 1 204 and image data decoding apparatus 1 208 
is as same as in Figure 1 1 . In Figure 1 2, Bs data encod- 

55 jng portion 1212 receives the value of the boundary 
strength Bs for each block boundary and encoded by 
any data encoding method which includes DPCM, multi- 
value run-length coding, transform coding with loss-less 
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feature and so on. The boundary strength Bs may be 
generated as described in Figure S. The encoded 
boundary strength may then be sent over the network 
1206. In one example, the encoded boundary strength 
may be sent separately from the encoded image data. 5 
In other example, the encoded boundary strength and 
the encoded image data may be multiplexed before 
sending over the network 1206. 
[0044] The encoded boundary strength may be re- 
ceived from the network 1206 and decoded by Bs data 10 
decoding portion 1214 to input the decoded boundary 
strength to image data decoding apparatus 1208. When 
the decoded boundary strength is utilized in image data 
decoding apparatus 1208 to perform the adaptive filter- 
ing of the present invention, it may not be necessary to *5 
repeat the process described in Figure 8 to generate 
boundary strength and this may save the processing 
power for the adaptive filtering. 
[0045] Having described and illustrated the principles 
of the invention in a preferred embodiment thereof, it 20 
should be apparent that the invention may be modified 
in arrangement and detail without departing from such 
principles. Claim is made to all modifications and varia- 
tion coming within the spirit and scope of the following 
claims. 25 



wherein said selectively filtering is based up- 
on determining whether at least two of said adjacent 
regions have an absolute difference (IV(j, x)-V(k, x) 
I; lV(j, y)-V(k, y)l) of said motion vectors of said at 
least two adjacent regions said absolute difference 
being at least one of greater than or less than a 
threshold value. 



Claims 

1 . An encoder for encoding an image (12) comprising: 30 

(a) a processor (54) adapted to identify adja- 
cent regions (44, 46; j, k) in said image; 

(b) said processor examining coding parame- 
ters (MV; 55) for said adjacent regions; and 35 

(c) said processor selectively filtering at least a 
portion (28) of the region proximate the bound- 
ary (26) between said adjacent regions based 
upon said coding parameters, 

40 

wherein said selectively filtering is based up- 
on determining whether at least two of said adjacent 
regions have an absolute difference (IV(j, x)-V(k, x) 
I; 'V(j, y)-V(k, y)l) of said motion vectors of said at 
least two adjacent regions at least one of greater 45 
than or less than a threshold value. 

2. A decoder for decoding an image comprising: 

(a) a processor (54) adapted to identify adja- 50 
cent regions (44, 46; j, k) in said image; 

(b) said processor examining coding parame- 
ters (MV; 55) for said adjacent regions; and 

(c) said processor selectively filtering at least a 
portion (28) of the region proximate the bound- 55 
ary (26) between said adjacent regions based 
upon said coding parameters, 
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